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Geometry  of  cyclic  pursuit 


K.  S.  Galloway,  E.  W.  Justh,  and  P.  S.  Krishnaprasad 


Abstract — Pursuit  strategies  (formulated  using  constant- 
speed  particle  models)  provide  a  means  for  achieving  cohesive 
behavior  in  systems  of  multiple  mobile  agents.  In  the  present 
paper,  we  explore  an  n- agent  cyclic  pursuit  scheme  (i.e.  agent  i 
pursues  agent  i  +  1,  modulo  n)  in  which  each  agent  employs  a 
constant  bearing  pursuit  strategy.  We  demonstrate  the  existence 
of  an  invariant  submanifold,  and  state  necessary  and  sufficient 
conditions  for  the  existence  of  rectilinear  and  circling  relative 
equilibria  on  that  submanifold.  We  present  a  full  analysis 
of  steady-state  solutions  and  stability  characteristics  for  two- 
particle  “mutual  CB  pursuit”  and  then  outline  steps  to  extend 
the  nonlinear  stability  analysis  to  the  many  particle  case. 

I.  Introduction 

Pursuit  and  evasion  phenomena  are  observed  throughout 
biology,  in  hunting  encounters  as  well  as  in  mating  and 
play.  Pursuit  also  plays  a  significant  role  in  the  vehicular 
setting,  in  military  encounters  between  planes  and  missiles 
or  between  adversarial  unmanned  vehicles.  Though  pursuit 
is  often  thought  of  as  a  competitive  phenomenon,  it  has 
been  shown  to  serve  as  a  means  of  achieving  cooperative 
behaviors  as  well.  (See,  for  instance,  Bruckstein’s  work 
on  ant  path-following  in  [1],  [2].)  Application  of  this  idea 
may  be  relevant  to  the  analysis  of  starling  flock  cohesion 
presented  in  [3].  In  the  current  work,  we  focus  on  a  cyclic 
pursuit  scheme  with  a  constant  bearing  pursuit  law  to  achieve 
group  cohesion  for  a  multi-agent  “flock.” 

Interest  in  cyclic  pursuit  dates  back  to  1877  when  Edouard 
Lucas  originally  posed  his  question  asking  what  trajectories 
would  be  traced  out  by  three  “dogs”  which  started  at  the 
vertices  of  an  equilateral  triangle  and  pursued  their  next 
neighbor  at  a  constant  speed.1  Since  that  time,  mathemati¬ 
cians  have  analyzed  various  facets  and  extensions  of  the 
problem,  demonstrating,  for  instance,  that  mutual  capture  is 
assured  in  the  three  “dog”  (or  “bug”)  problem  but  non-mutual 
capture  is  possible  in  the  more  general  case  (i.e.  for  n  >  3). 
(See  [8]  and  [13]  respectively.)  Recently,  there  has  been  a 
renewed  interest  in  studying  cyclic  pursuit  from  a  control- 
theoretic  perspective,  particularly  for  decentralized  control  of 
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1  See  [13]  for  a  nice  historical  summary  of  the  cyclic  pursuit  problem. 


groups  of  autonomous  agents.  In  [9],  Marshall,  Broucke  and 
Francis  present  an  analysis  of  wheeled  vehicles  (modeled 
as  kinematic  unicycles)  engaged  in  cyclic  pursuit,  moving 
at  a  fixed  common  vehicle  speed  and  employing  a  steering 
law  dependent  on  linear  feedback  of  the  relative  bearing 
error.  The  authors  prove  the  existence  of  2  (n  —  1)  relative 
equilibrium  formations  and  conduct  local  stability  analysis  of 
the  equilibria  based  on  linearization  of  the  shape  dynamics. 
In  [10],  the  authors  extend  their  analysis  to  incorporate 
feedback  control  of  the  vehicle  speeds  as  well,  presenting  a 
global  stability  analysis  for  the  two-particle  case  and  a  local 
stability  analysis  for  the  general  case.  In  [14],  Sinha  and 
Ghose  present  a  generalization  of  this  previous  work  which 
involves  heterogeneous  formations  of  agents  with  differing 
speeds  as  well  as  differing  controller  gains.  Variations  on 
the  theme  are  presented  in  [15]  (a  hierarchical  cyclic  pursuit 
scheme),  [16]  (with  applications  to  rendezvous  problems  and 
curve-shortening),  and  [12]  (with  applications  to  coverage). 

The  contribution  of  the  current  work  lies  in  the  nonlinear 
nature  of  both  the  steering  law  and  the  stability  analysis. 
We  begin  by  briefly  describing  the  particle  model  dynamics 
(section  II)  and  introducing  the  constant  bearing  pursuit  law 
(section  III).  This  constant  bearing  pursuit  law  (originally 
developed  in  [17])  involves  the  relative  bearing  error  as 
well  as  a  term  similar  to  the  “motion  camouflage”  law 
in  [6],  In  section  IV  we  discuss  the  reduction  to  “shape 
space,”  providing  an  explicit  parametrization  and  describ¬ 
ing  an  invariant  submanifold  with  reduced  dynamics.  After 
stating  propositions  concerning  conditions  for  the  existence 
of  special  solutions  (e.g.  relative  equilibria)  on  the  invariant 
submanifold,  we  present  the  full  two-particle  analysis  and 
sketch  an  extension  to  the  many  particle  case  in  section  VII. 

II.  Modeling  interactions 

We  describe  the  movement  of  agents  in  our  system  as  unit- 
mass  particles  tracing  out  twice  continuously-differentiable 
curves  in  R2,  deriving  our  dynamics  from  the  natural 
Frenet  frame  equations  (see,  e.g.,  [5]  for  details).  (A  three- 
dimensional  analysis  of  cyclic  pursuit  formulated  in  terms 
of  the  natural  Frenet  frame  equations  is  a  topic  of  ongoing 
work.)  As  is  depicted  in  figure  1,  we  let  r,  denote  the  position 
of  the  ith  particle  (with  respect  to  a  fixed  inertial  frame), 
x,  denote  the  unit  tangent  vector  to  the  curve,  and  y,  the 
unit  vector  normal  to  x,.  An  /(-agent  system  then  evolves 
according  to  the  particle  dynamics  given  by 

fj  =  l/,;X,;, 

X;  =  ViYiUi, 

Yi  =  — t'jXjMj,  i  =  1, 2, . . . ,  n.  (1) 
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Fig.  1.  Illustration  of  particle  positions  and  corresponding  natural  Frenet 
frames  for  three  particles  in  the  plane. 


Here  y,  =  x.,1  ,  by  which  we  mean  that  rotating  x,  counter¬ 
clockwise  in  the  plane  by  7r/2  radians  gives  y,:.  Note  that 
17,  the  speed  of  particle  i,  could  possibly  be  given  by  a 
time-varying  function,  but  here  it  is  constant  and  equal  to 
1.  Our  controls,  iq,  can  be  viewed  as  curvature  controls  or 
steering  controls  in  the  planar  setting.  We  also  define  the 
“baseline  vectors”  ri  i+1  by  r !t!+1  =  r,—  ri+1,  *  =  1,2, n 
(interpreted  modulo  n  throughout  this  paper). 

System  (1)  evolves  on  the  manifold  Mstate  defined  by 


M state  ={(r1,x1,y1,.. .  ,r„,x„,y„)  G  K6”  rt  ±  ri+1, 

lxt  I  =  1,  y  i  =  X(L,  i  =  1,2,  ...,n|. 


(2) 


Note  that  we  have  only  disallowed  “sequential  collocation”, 
i.e.  the  state  manifold  does  not  include  states  for  which  r,  = 
ri+1.  In  terms  of  pursuit,  this  means  that  we  restrict  our 
analysis  away  from  the  point  of  actual  capture/rendezvous, 
allowing  well-posedness  of  the  feedback  laws  of  section  III. 


III.  Pursuit  strategies  and  steering  laws 


We  describe  pursuit  interactions  in  terms  of  the  geometry 
of  the  encounter,  typically  in  terms  of  relative  positions  and 
velocities.  The  analysis  in  [17]  concerns  several  of  these 
geometric  depictions  of  pursuit  (or  pursuit  strategies),  includ¬ 
ing  Classical  Pursuit  (CP),  Constant  Bearing  Pursuit  (CB), 
and  Motion  Camouflage  Pursuit  (MC),  and  demonstrates  that 
appropriate  cost  functions  and  associated  pursuit  manifolds 
can  be  defined  for  each  pursuit  strategy.  For  a  two-particle 
system  with  particle  i  pursuing  particle  i  +  1,  we  define 
cost  functions  for  Motion  Camouflage  Pursuit  and  Constant 
Bearing  Pursuit,  respectively,  by  I’,;  :  Mstate  — >  and 

Aj  :  Mstate  R. 


r, 


lrM+ll 

drj,i+1 

dt 


d 

dt 


-A-  i  — 


_  /  rM+i 

\lrM+l| 

1 

lrM+l|’ 


ii,i+ 1  \ 


(3) 

(4) 


where  G  [0,  27t)  is  the  offset  angle  for  the  constant  bearing 
pursuit2  and  ll(a,)  G  SO(2)  is  the  rotation  matrix  defined 

by 


R(cti) 


cos(aj)  —  sin(cti) 
sin(cu)  cos(ai) 


(5) 


(Since  Classical  Pursuit  is  a  special  case  of  Constant  Bearing 
Pursuit,  we  can  define  the  associated  cost  functions  by 
substituting  a*  =  0  into  (4).)  Then,  as  in  [17],  we  have 
the  associated  pursuit  manifolds  defined  by  I’,;  =  —1  and 
A,;  =  —  1  and  we  can  derive  steering  laws  to  drive  the  system 
toward  the  desired  pursuit  manifold.  In  particular,  we  have 
for  MC, 


UMC(i)  = 

and  for  CB, 


/  rM+i 

vlrM+il 


(6) 


UCB(ai)  =  ~Pi 


(^R{oti) yt  ■ 

1 

lrM+i 


1  \ 
lrM+il/ 

VlrM+i| 


(7) 


where  /j,  >  0  is  a  control  gain. 

We  will  focus  on  the  CB  pursuit  law  (7)  for  our  analysis 
of  cyclic  pursuit. 


Remark:  The  classical  work  on  cyclic  pursuit  (e.g.,  as  in 
[8]),  and  the  more  recent  work  of  Bruckstein  et  al.  [2]  and 
Richardson  [13],  presuppose  that  the  CP  strategy  is  exactly 
realized  (with  no  reference  to  a  feedback  law).  On  the  other 
hand,  [10]  is  based  on  a  linear  feedback  law  motivated  by 
the  CP  strategy. 


IV.  Symmetry,  shape  and  reduction 

Pursuit  laws  (6)  and  (7)  leave  our  system  dynamics  (1) 
invariant  under  the  action  of  the  special  Euclidean  group 
SE(2)  and  therefore  permit  reduction  to  the  quotient  manifold 
Mstatel SE(2),  also  known  as  the  shape  space.  The  shape 
space  describes  the  relative  positions  and  velocities  of  the 
agents  in  the  system. 

A  particularly  useful  parametrization  of  this  shape  space 
is  given  by  (c.f.  [5]) 

Pi  =  |ri,i+l|  > 

4*i  x?  '  x?-(-l ) 

7 i  =  xi  •  y*+i, 


Si  =  Yi  ■  ,rM+1|,  i  =  1,2 (8) 

Ki+il 

Note  that  <f>i  and  7 *  are  dot  products  of  unit  vectors,  as  are 
Pi  and  Si,  and  they  satisfy 

^+T?  =  1,  P?  +  Si=  1,  i  =  l,2,...,n.  (9) 

2Note  that  =  0  corresponds  to  classical  pursuit.  For  tv/ 2  <  OLi  < 
37r/2,  the  pursuer’s  feedback  law  drives  its  velocity  vector  away  from  the 
“pursuee”  so  it  may  be  more  appropriate  to  describe  the  strategy  as  constant 
bearing  “evasion”  as  opposed  to  “pursuit”. 
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We  can  derive  the  associated  shape  dynamics  by  first  calcu¬ 
lating  the  derivative  of  p^  as  follows: 

Pi  =  ^  ki.i+il  =  l,(ri,i+i  '  i"i,i+i)~1/2(2rM+i  •  ri)i+i) 

=  (Xj  -  xi+1)  •  ri,'+1  =  Pi  -  {pA  -  yA) 

Tm+i  I 

=  Pi(l  -  pi)  +  iA.  (10) 


(Note  that  the  simplification  in  the  second  line  is  made  pos¬ 
sible  by  expressing  xi+1  in  terms  of  x,;  and  y,;  components.) 


Remark:  It  is  possible  to  derive  the  following  expressions 
for  the  CB  cost  function  (4)  and  the  CB  pursuit  law  (7)  in 
terms  of  the  shape  variables: 


A  i  =  cos  (a,)A  +  sin(ctj)<5j;, 
ucB(ai)  =  Pi  [sin(aj)/?j  -  cos^)^] 

-  —  [<5,(1  -  fa)  -  jiPi]  . 

Pi 

Noting  that 

d  ri,i+l  _  d  r iti+lpi  —  rj.,;_|_i/3i 


dt  |ri)i+1|  dt  p. 

1 

Pi- 


Pi 


(11) 

(12) 


x*  -  x  i+i 


-^-\Pi{l-pi)  +  lA] 


Li,i+ 11 


(13) 


it  is  a  straightforward  (though  somewhat  lengthy)  exercise  to 
show  that  our  resultant  shape  dynamics  can  be  expressed  as 

Pi  =  0i  (1  -  <f>i)  + 

4*i  — 

7 i  — 

Pi  =  uA  +  —  [Af  (l  -  pi)  -  PipfA)] , 

Pi 

Si  =  -u-iPi  +  —  [7 iPf  -  PiSi  (1  -  pi)]  ,  (14) 

Pi 

i  =  1,2, ...  ,n,  with  (9)  as  constraints  on  the  initial  condi¬ 
tions. 


Remark:  The  dynamics  given  by  (14)  hold  for  any  SE( 2)- 
invariant  (feedback)  control  ip. 

If  we  further  impose  a  cyclic  pursuit  scheme  (i.e.  i  pursues 
i  + 1,  modulo  n)  with  each  particle  using  the  CB  pursuit  law 
given  by  (7),  our  closed-loop  shape  dynamics  are  given  by 

Pi  =  Pi  { 1  -  Pi)  +  lA , 

Pi  =  —li{uCB(ai)  ~  uCB(ai+1 ))> 

li  =  Pi{UCB(aa)  ~  uCB(ai+ i))i 

Pi  =  pi  [sin(al)/3,Ai  -  cos  (a; )  <5, 2  ]  , 

Si  =  Pi  [cos (a* )PA  -  sm(ati)Pi]  ,  (15) 

i  =  1,2 ,...,n,  with  (9)  again  providing  constraints  on 
the  initial  conditions.  (The  expressions  for  pi  and  7,  do 
not  simplify  greatly  with  the  substitution  of  (7)  or  (12), 
and  therefore  we  have  not  expressed  them  in  their  full 


explicit  form.)  One  should  note  that  under  these  closed- 
loop  dynamics,  the  evolution  of  the  subsystem  <5,;j  is 
dependent  only  on  !3r  and  S-, ,  an  important  fact  which  will 
be  discussed  in  greater  detail  later  in  the  paper. 


A.  An  invariant  submanifold 

We  can  now  define  an  important  submanifold  of  the  state 
space  corresponding  to  system  states  for  which  each  agent 
has  achieved  CB  pursuit  of  the  next  agent.  As  discussed 
previously.  A,  =  —  1  if  and  only  if  agent  i  has  achieved  CB 
pursuit  of  agent  i+ 1,  and  therefore  we  define  the  CB  Pursuit 
Manifold  MCb(<x )  C  Mstate  by 

^dcB(a)  |(ri)Xi,yi, . . .  ,r„, xn, y n)  C  Mstate  | 

A*  = -1,*  =  1,2, ...  ,n|,  (16) 

where  a  =  (07,  ol-i,  . . . ,  an).  (Note  that  we  could  equally  as 
well  define  Mcsia)  as  a  submanifold  of  the  shape  space,  as 
is  made  evident  by  (11).)  In  [17],  it  is  demonstrated  that  the 
derivative  of  A,;  under  pursuit  law  (7)  can  be  expressed  as 
A,  =  — pi  (l  —  Af).  Noting  that  this  holds  regardless  of  the 
maneuver  of  the  pursuee  (i.e.  agent  i  +  1)  and  that  A*  =  0 
for  A,  =  —1,  we  can  state  that  MCB(a)  is  invariant  under 
cyclic  pursuit  dynamics  with  pursuit  law  (7). 


We  can  formulate  reduced  dynamics  on  Mcb{u)  in  terms 
of  the  shape  variables  (8)  as  follows.  By  expressing  x.(  in  the 
basis  {R(ai)tCi,  R(ai)yi}  and  making  use  of  the  fact  that 

a  i  =  R(ai)xi  •  =  ^-e-  =  °) on 

MCB(a),  we  have 


Pi  =  Xj 


1 

lrM+i| 

fxj  •  R(ai)xi  )R(ai)xi 
( 

X,; 


(xi  ■  R(ai)yi')  R(ai)yi 


=  c-os (ai)R(ai)xi  ■ 
=  —  cos  (a-i). 


1  i,i-\- 1 

lri,i+l| 


ki.i+il 

-  sin(ai)i?(al)yJ: 


^i,i+l 

|r*,i+i| 

(17) 


Similar  calculations  yield 

Si  =  -sin(a»)^  (18) 


and  therefore  we  have  the  following  reduced  system  dynam¬ 
ics  on  MCB(ay. 

pi  =  -  (1  -  pi)  cos(a,)  -  7 1  sin(aj), 


=  ~li 


—  ( (1  -  Pi)  sin(aj)  -  7 i  cos(a, 
L  Pi 


1  -  pi+ 1)  sin(ai+i)  -  7,;+i  cos(a,;+i) 


Pi+ 1 


li  =  Pi 


l^7  ((1  -  Pi)  sin(aj)  -  7 % cos(ct;)) 


1 


Pi+ 1 

Pi  =  0, 

S-i,  =  0,  i  =  1,2, ...  ,n. 


1  -  pi+ 1)  sin(ai+i)  -  7»+i  cos(a,;+i 


(19) 
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Remark:  Richardson’s  model  ([13])  is  confined  to  the  CP 
manifold  and  obeys  equation  (19)  with  on  =  0,  Vi. 

Existence  of  the  invariant  submanifold  Mqb{<x)  011  which 
the  system  shape  evolves  according  to  these  reduced  shape 
dynamics  suggests  a  two-part  approach  for  characterization 
of  the  solution  space  and  subsequent  stability  analysis.  The 
first  part  of  our  approach  will  entail  analysis  of  the  solutions 
and  stability  properties  of  the  reduced  dynamics  on  the 
CB  Pursuit  Manifold,  and  the  other  part  will  focus  on  the 
evolution  of  the  system  on  the  full  shape  space,  unrestricted 
to  (but  possibly  converging  to)  the  CB  Pursuit  Manifold.  We 
sketch  this  latter  step  in  section  VII. 

V.  Special  solutions 

Here  we  characterize  possible  special  solutions  for  the 
system  dynamics  and  determine  criteria  for  their  existence. 
We  will  discuss  relative  equilibria  as  well  as  a  more  general 
type  of  special  solution. 

A.  Relative  equilibria 

Equilibria  of  the  shape  space  dynamics  (14)  correspond 
to  relative  equilibria  of  the  full  system  dynamics  (1).  As 
is  demonstrated  in  [5],  system  dynamics  of  the  form  (1) 
permit  only  two  types  of  relative  equilibria:  rectilinear  and 
circling.  For  a  rectilinear  relative  equilibrium,  all  the  particle 
velocities  are  aligned  (i.e.  <pi  =  1,  i  =  1,2 ,...,n)  and 
Mi  =  U2  =  •  •  •  =  ttn  =  0.  For  a  circling  relative  equilibrium, 
the  particles  travel  on  a  common  closed  circular  trajectory, 
separated  by  fixed  chordal  distances.  At  this  relative  equilib¬ 
rium,  we  have  u\  =  U2  =  ■  ■  ■  =  un  =  ^  0,  where  rc  is 

the  radius  of  the  circular  orbit. 

We  now  state  propositions  concerning  the  existence  of 
relative  equilibria  in  terms  of  conditions  on  the  CB  angles 
{ai,  Q2,  •  •  • , ctn}.  Note  that  we  restrict  our  attention  to 
relative  equilibria  existing  on  the  submanifold  Mcb(u)  due 
to  stability  properties  of  this  particular  submanifold  which 
will  be  discussed  in  section  VII.  The  first  proposition  deals 
with  rectilinear  motion,  and  the  second  with  circling  motion. 

Proposition  1:  Given  {ai,at2,  ■  ■  ■  ,an},  a  relative  equilib¬ 
rium  corresponding  to  rectilinear  motion  on  Mcb(o)  exists 
for  system  (1)  under  cyclic  pursuit  with  CB(q)  control 
law  (7)  if  and  only  if  there  exists  a  set  of  constants 
{a i,  (72, . .  • ,  cr„}  such  that  cu  >  0,  i  =  1, 2, . . .  ,n  and 

n 

Y  ^eja‘  =  °.  (20) 

i=l 

where  j  =  \/—l. 

Proof:  See  Appendix  in  [4]. 

Proposition  2:  Given  {a\,a  2,  ...,an},  a  relative  equilib¬ 
rium  corresponding  to  circling  motion  on  a  common  orbit 
on  McB(a)  exists  for  system  (1)  under  cyclic  pursuit  with 


CB(q)  control  law  (7)  if  and  only  if 

i.  sin(aj)  >0  Vz  €  {1, 2, . . . ,  n}  or 
sin(aj)  <0  Vi  €  {1, 2, ... ,  n}, 

ii.  sin  =0.  (21) 

Proof:  See  Appendix  in  [4]. 

Remark:  Note  that  the  condition  of  Proposition  1  and 
condition  (i)  of  Proposition  2  are  mutually  exclusive,  and 
therefore  the  set  of  all  possible  {a\,  ct2,  ■  ■  ■ ,  an}  for  which 
rectilinear  equilibria  exist  is  disjoint  from  the  set  of  all 
possible  {ai,  «2)  •  •  • ,  an}  f°r  which  circling  equilibria  exist. 
Also,  the  two  cases  in  condition  (i)  of  Proposition  2  corre¬ 
spond  to  the  choice  of  either  clockwise  or  counter-clockwise 
circling  equilibria. 

B.  Other  special  solutions 

A  collection  of  particles  in  cyclic  pursuit  can  be  viewed  as 
a  planar  polygon  with  labeled  vertices  (i.e.  the  sides  connect 
particle  z  to  particle  i  +  1).  It  is  possible  to  discuss  the 
“shape”  and  “size”  of  a  particle  polygon  with  the  usual 
geometric  meanings  of  these  terms.  A  relative  equilibrium  is 
then  a  system  trajectory  for  which  the  size  and  shape  of  the 
associated  particle  polygon  remain  invariant.  Our  continued 
analysis  and  numerical  simulations  have  demonstrated  that  a 
more  general  type  of  special  solution  exists,  for  which  the 
shape  of  the  associated  particle  polygon  remains  invariant 
but  the  size  is  time-varying.  Typically,  these  solutions  are 
characterized  by  either  spiraling  out  or  spiraling  in.  Explicit 
examples  are  discussed  for  the  two-particle  case  in  section 
VI. 

VI.  Mutual  CB  pursuit 

In  the  two-particle  case,  cyclic  pursuit  is  more  aptly  de¬ 
scribed  as  mutual  pursuit.  In  this  case,  we  are  able  to  perform 
a  global  stability  analysis  and  fully  describe  the  steady- 
state  solutions  as  parametrized  by  a\  and  0:2.  We  note  that 
the  n  =  2  case  provides  valuable  insight  into  methods  for 
attempting  stability  analysis  of  higher-dimensional  systems 
(i.e.  for  n  >  2). 

In  the  two-particle  case,  we  are  able  to  derive  a  simplified 
form  of  the  shape  dynamics  (15)  as  follows.  First,  the 
obvious  symmetries  in  the  two-particle  case  allow  for  the 
assignment 

4>  =  4>i  =  (f>2,  7  =  7i  =  -72,  P=  Pi  =  Pi-  (22) 

Then,  making  use  of  the  orthogonal  decomposition  of  X2  (in 
terms  of  ,ri~r2,  and  (l[1~r2)l  )  and  the  identity  a  •  bx  = 

|ri— r2|  |ri-r2|  J 

—a-1  •  b,  we  have 

<j>= -fiifo- 5i52,  7  =  — /3i<5^2  +  8\f32.  (23) 
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Substituting  these  expressions  into  our  shape  dynamics  (15), 
we  then  have  the  simplified  two-particle  version  given  by 

P  —  Pi  +  P2, 

Pi  =  Mi  [sin(ai)/3i5i  —  cos(ai)(Sf]  , 

Pi  =  M2  [sin(a2)/?2c>2  -  cos(a2)6f]  > 

5i  =  Mi  [cos(ai)/3i<5i  —  sin(ai)/31]  , 

<52  =  M2  [cos(a2)/32c>2  -  sin(a2)/jf]  ,  (24) 

with  the  auxiliary  algebraic  equations 


The  results  are  summarized  in  table  I  and  illustrated  in  figure 
2. 

Remark:  For  cti  =  a2,  the  center  of  mass  (i.e.  |  (ri  +  r2)) 
remains  fixed.  If  a\  -  a2  and  ejai  +  eja-  does  not  lie  on 
one  of  the  axes,  then  the  particles  will  spiral  out  or  spiral  in 
around  the  center  of  mass. 

Remark:  In  work  to  appear  [11],  Mischiati  and  Krish- 
naprasad  have  investigated  mutual  pursuit  under  motion 
camouflage. 


p=  -P1P2-  SiS2,  7  =  ~PiS2  +  Si/32, 

Pl+5\  =  1,  Pl  +  6l  =  1.  (25) 


As  noted  previously,  since  yfa,  <5,  j  depends  only  on  Pi  and 
Si  (for  i  =  1, 2)  we  can  separately  analyze  these  sub-systems. 
Due  to  the  orthogonality  condition  Pf + S'f  =  1,  it  can  readily 
be  shown  that  each  subsystem  has  two  equilibrium  points  at 

(Pi,  Si)  =  ±^cos(al),sin(al)j. 


Proposition  3:  For  i  =  1,2,  the  point  (Pi,  Si)  = 

—  ^cos(a,;),  sin(a,;)  j  is  an  asymptotically  stable  equilibrium 

point  for  the  subsystem  (^fa,  S^ ,  with  region  of  convergence 


given 


by  j  (/?»)<*»)  G  S'1  (Pi,  Si)  ^cos(aj)  ,  sin(a.j)^  |. 


Proof:  Use  Lyapunov’s  indirect  method  to  show  that  the 
equilibrium  point  at  (Pi,Sf)  —  ^cos(a,), sin(a,)^  is  un¬ 
stable.  Then  use  LaSalle’s  invariance  principle([7])  with 
Lyapunov  function  A.;  =  cos(a-i)Pi  +  sin(ai)(5j  to  prove 
asymptotic  stability  of  the  other  equilibrium  point.  □ 


Note  from  (17)  and  (18)  that  (Pi,Si)  = 
—  ^cos(a,), sin(a,)^ ,  i  =  1,2,  corresponds  to  our  definition 
of  MqB (a)  f°r  the  two-particle  case,  so  Proposition  3 
establishes  asymptotic  convergence  to  McB(a)-  The  rate 
of  convergence  is  governed  by  the  control  gains  mi  and 
//2.  We  therefore  seek  to  describe  the  system  dynamics  on 
McB(a)  as  parametrized  by  the  particular  values  of  ai,a2, 
i.e.  the  asymptotic  behavior  of  the  system. 

On  McB^ay  the  only  (possibly)  nonzero  portion  of  the 
shape  dynamics  is  given  by 


p  =  Pi  +  p2  =  -  [cos(aii)  +  cos(a2)] .  (26) 


We  can  also  derive  an  expression  for  the  controls 
ucb( ai)(t)  on  Mcb(u),  starting  from  (12)  and  substituting 
for  fan,  fa,  Si  to  get 


uCB(ai)(t) 


1 

P(t) 


[sin(ai)  +  sin(a2)] ,  1  =  1,2. 


(27) 


Since  the  respective  signs  of  p  and  u(t)  =  uqb( ai)(f)  = 
ucB(a2)(t)  are  determined  by  the  respective  signs  of  the 
quantities  [cos(ai)  +  cos(a2)]  and  [sin(a!)  +  sin(a2)],  we 
can  concisely  state  our  characterization  of  the  manifold  in 
terms  of  vector  addition  in  the  complex  plane,  noting  that 


faai  +  e-7"2  =  [cos(ai)  +  cos(a2)]  +  j  [sin(ai)  +  sin(a2)] 
=  -p  +  jpu.  (28) 


VII.  Stability  for  many  particles 

As  was  previously  alluded  to  at  the  end  of  section  IV-A, 
the  form  of  the  cyclic  CB  closed-loop  shape  dynamics  (15) 
suggests  an  approach  to  stability  analysis  which  involves  a 
separate  investigation  of  convergence  to  McB(a)  and  conver¬ 
gence  to  special  solutions  on  Mcb(<x),  in  a  manner  somewhat 
reminiscent  of  center  manifold  theory.  Here  we  sketch  an 
outline  of  this  approach,  with  the  intent  of  presenting  a  more 
complete  analysis  in  future  work. 

A.  Convergence  to  the  invariant  manifold 

We  suggest  that  the  path  for  proving  system  convergence 
to  the  invariant  manifold  MGB(a\  lies  in  following  an 
approach  analogous  to  that  demonstrated  in  the  two-particle 
analysis  presented  in  section  VI.  In  the  two-particle  case, 
the  cost  function  A,  (for  i  =  1,2)  was  used  as  a  Lyapunov 
function  to  prove  (by  way  of  the  invariance  principle)  that  the 
and  subsystems  converge  to  equilibrium 

points  corresponding  to  the  definition  of  Mcb(<x)-  In  an 
analogous  approach  for  the  n  >  2  case,  we  define  the 
projection  function  A  :  Mstate/SE( 2)  — >  [—1,  l]n  by 

^(Pl ,  7l  5  Pi ,  ^1 5  Pi ,  •  •  •  ,  Pn ,  An ,  Pn ,  Sn ,  Pn) 

=  (Ar,  A2, . . . ,  A„),  (29) 

with  A,;  as  defined  by  (11),  and  then  discuss  convergence 
to  Mcs(a)  in  terms  of  convergence  of  A  to  the  corre¬ 
sponding  point  (—1,  —1, . . . ,  —  1)T  G  [—1,  l]n.  (A  Lyapunov 
function  such  as  V  =  Xa=i  should  serve  the  purpose.) 
Further  analysis  is  required  to  complete  the  technical  proof 
(note,  for  instance,  that  care  must  be  taken  since  the  point 
(— 1,  —  1, . . . ,  —  1)T  lies  on  the  boundary  of  [—  1,  l]n),  but 
the  outlined  approach  seems  to  point  the  way  to  a  nonlinear 
stability  analysis  for  the  many  particle  case. 

B.  Convergence  to  special  solutions  on  the  invariant  mani¬ 
fold 

The  second  portion  of  the  stability  analysis  focuses  on 
the  reduced  dynamics  (19)  which  govern  the  system  shape 
evolution  on  McB(a)-  This  analysis  requires  both  the  char¬ 
acterization  of  all  steady-state  solutions  corresponding  to  a 
given  set  of  CB  angles  {ai,  a2, . . . ,  an}  as  well  as  a  deter¬ 
mination  of  the  stability  properties  of  these  solutions.  The 
beginning  steps  in  this  process  were  described  in  section  V 
with  the  identification  of  necessary  and  sufficient  conditions 
for  the  existence  of  relative  equilibria  and  the  description 
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TABLE  i 

Characterization  of  the  asymptotic  behavior  for  mutual  CB  pursuit 


Case 

p(i);  «(*) 

eJa  i  +  eJa2 

Description 

I. 

p(t)  =  0;  u(t )  =  0 

0 

rectilinear  equilibrium 

II. 

III 

o 

ir-t- 

V 

o 

positive  imaginary  axis 

CCW  circling  equilibrium 

III. 

p(t)  =  0;  u{t )  <  0 

negative  imaginary  axis 

CW  circling  equilibrium 

IV. 

p(t)  <  0;  u(t)  =  0 

positive  real  axis 

“straight  flight  rendezvous” 

V. 

p(t)  >  0;  u(t)  =  0 

negative  real  axis 

“straight  flight  retreat” 

VI. 

p(t)  <  0;  u(t)  >  0 

quadrant  I 

CCW  “inward  sweep” 

VII. 

p(t)  >  0;  u{t)  >  0 

quadrant  II 

CCW  “outward  sweep” 

VIII. 

p(t)  >  0;  u{t)  <  0 

quadrant  III 

CW  “outward  sweep” 

IX. 

p(t)  <  0;  u{t)  <  0 

quadrant  IV 

CW  “inward  sweep” 

a,  =  0.3333371.  a2 


.333371 


=  1.25*.  a3  =  1.75* 


a,  =0.66667*.  a2  =  0.66667* 


(a)  Case  I:  Rectilinear  equilibrium  (b)  Case  III:  CW  circling  equilibrium  (c)  Case  VII:  CCW  “outward  sweep” 

(7r/3,  47r/3)  (57t/4,  77t/4)  (27t/3,  27r/3) 

Fig.  2.  These  MATLAB  simulations  illustrate  a  selection  of  the  different  cases  described  in  table  I.  The  particular  choices  of  (cti,  0:2 )  for  each  simulation 
are  listed  in  the  captions  associated  with  each  figure. 


of  other  special  solutions;  the  classification  presented  in  the 
two-particle  case  may  provide  the  framework  for  charac¬ 
terizing  all  possible  steady-state  solutions.  Convergence  to 
these  particular  solutions  can  then  be  addressed  in  terms  of 
Lyapunov  analysis  with  the  reduced  dynamics  (19). 

VIII.  Conclusion 

In  this  work  we  have  presented  a  formulation  of  a  cyclic 
pursuit  scheme  with  a  constant  bearing  pursuit  law.  By  an 
explicit  reduction  to  shape  space,  we  have  demonstrated  the 
existence  of  the  invariant  submanifold  McB(a)  and  provided 
necessary  and  sufficient  conditions  for  existence  of  relative 
equilibria  on  that  submanifold.  For  the  two-particle  case, 
we  have  proved  asymptotic  convergence  to  and 

developed  a  full  characterization  of  the  possible  steady-state 
solutions  in  terms  of  the  CB  angles.  Finally,  we  have  outlined 
an  approach  for  nonlinear  stability  analysis  in  the  many 
particle  case. 

Work  in  progress  (in  addition  to  that  which  was  outlined 
in  section  VII)  includes  a  generalization  to  the  full  three- 
dimensional  case  (with  cyclic  pursuit  on  the  sphere  as  an 
intermediate  step)  as  well  as  allowing  for  time-varying  CB 
angles  a:,  . 
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